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Related Files 

This application is a continuation-in-part of United States Patent Application 
serial number 09/179,807, entitled "OFF-LINE PERSON NOTIFIER", filed October 27, 
1998 (attorney docket number 450.228US1); which is hereby incorporated by reference 
for all purposes. 

Field of the Invention 

The present invention relates to systems and methods for instant messaging 
communications, and in particular to providing voice telephone access to an instant 
messaging client. 



Background of the Invention 
Instant messaging (EM) has become a common way for online users to 
communicate with one another. Typical instant messaging systems provide client 
programs that enable users to locate and establish an independent chat session with 

20 another user. Once connected, users can exchange comments in real time and with some 
systems, share files. As text is typed in on one user's computer system, it is displayed on 
the other's computer system and vice versa. 

While instant messaging systems provide distinct advantages to online users, 
some problems exist. For example, in current systems, both parties in an instant message 

25 session must be at a computer. A person may desire to contact an individual who may be 
on-line and have access to their instant messaging clients, but that person does not have 
access to a computer. Alternatively, a person may need to reach someone who is on a 
dial-up system, and on-line, however the person cannot call them as their line is currently 
tied up by the computer. 

30 In view of the above problems, there is a need in the art for the present invention. 
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Summary of the Invention 



The present invention includes systems and methods that allow a user at a 
telephone to communicate with an instant messaging client. The instant messaging client 
5 may be identified by a PIN that is entered on the telephone. Input from the telephone, 
including keypad and voice input may be converted to text that is displayed to the M 
client. Text data received from the IM client may be converted to speech that is output to 
the telephone. 

A further aspect of the system is that PIN data may be maintained in a database 
10 that maps PINs to IM user identifications. A single PIN may be used to map to multiple 
IM user identifications used by an individual. 

The present invention describes systems, clients, servers, methods, and computer- 
readable media of varying scope. In addition to the aspects and advantages of the present 
invention described in this summary, further aspects and advantages of the invention will 
15 become apparent by reference to the drawings and by reading the detailed description that 
follows. 



Brief Description of the Drawings 
FIG. 1 is a block diagram illustrating an operating environment that includes systems 
20 according to an embodiment of the invention for contacting instant messaging 

clients using a telephone. 
FIG. 2 A is a flowchart illustrating a method according to an embodiment of the invention 

for contacting instant messaging clients using a telephone. 
FIG. 2B is a flowchart illustrating a method according to an embodiment of the invention 
25 for maintaining instant message client status information according to an 

embodiment of the invention. 
FIG. 3 is a block diagram of an example computer for implementing certain aspects of 
the present invention. 

30 
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Detailed Description of the Invention 



In the following detailed description of exemplary embodiments of the invention, 
reference is made to the accompanying drawings that form a part hereof, and in which is 
5 shown by way of illustration specific exemplary embodiments in which the invention 
may be practiced. These embodiments are described in sufficient detail to enable those 
skilled in the art to practice the invention, and it is to be understood that other 
embodiments may be utilized and that logical, mechanical, electrical and other changes 
may be made without departing from the scope of the present invention. 

10 Some portions of the detailed descriptions that follow are presented in terms of 

algorithms and symbolic representations of operations on data bits within a computer 
memory. These algorithmic descriptions and representations are the ways used by those 
skilled in the data processing arts to most effectively convey the substance of their work 
to others skilled in the art. An algorithm is here, and generally, conceived to be a self- 

15 consistent sequence of steps leading to a desired result. The steps are those requiring 
physical manipulations of physical quantities. Usually, though not necessarily, these 
quantities take the form of electrical or magnetic signals capable of being stored, 
transferred, combined, compared, and otherwise manipulated. It has proven convenient 
at times, principally for reasons of common usage, to refer to these signals as bits, values, 

20 elements, symbols, characters, terms, numbers, or the like. It should be borne in mind, 
however, that all of these and similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels applied to these quantities. Unless 
specifically stated otherwise as apparent from the following discussions, terms such as 
"processing" or "computing" or "calculating" or "determining" or "displaying" or the 

25 like, refer to the action and processes of a computer system, or similar computing device, 
that manipulates and transforms data represented as physical (e.g., electronic) quantities 
within the computer system's registers and memories into other data similarly 
represented as physical quantities within the computer system memories or registers or 
other such information storage, transmission or display devices. 

30 The functions or algorithms described herein are implemented in software, 

human, or a combination of software and human implemented procedures in one 
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embodiment. The software comprises computer executable instructions stored on 
computer readable media such as memory or other type of storage devices. The term 
"computer readable media" is also used to represent carrier waves on which the software 
is transmitted. Further, such functions correspond to modules, which are software, 
5 hardware, firmware or any combination thereof. Multiple functions are performed in 
one or more modules as desired, and the embodiments described are merely examples. 
The software may be executed on a digital signal processor, ASIC, microprocessor, or 
other type of processor operating on a computer system, such as a personal computer, 
server or other computer system. 

10 In the Figures, the same reference number is used throughout to refer to an 

identical component which appears in multiple Figures. Signals and connections may be 
referred to by the same reference number or label, and the actual meaning will be clear 
from its use in the context of the description. 

The following detailed description is, therefore, not to be taken in a limiting 

15 sense, and the scope of the present invention is defined only by the appended claims. 

Operatine Environment 

FIG. 1 is a block diagram illustrating an exemplary environment in which systems 
20 incorporating embodiments of the invention may be practiced. In some embodiments, the 
exemplary environment includes voice instant messaging (IM) server 110, pin database 
120, telephone 102, and instant messaging client 140 communicably coupled to voice IM 
server 1 10 via a network 130. 

Telephone 102 may be any type of device capable of providing voice and keypad 
25 signals to a telephone network. Telephone 102 may be a wired telephone device, or it 
may be a wireless device such as a cellular phone or a personal digital assistant (PDA) 
with cellular phone capability. The invention is not limited to any particular type of 
telephone device. 

Telephone 102 is used to communicate with an instant messaging client 140 
30 through voice IM server 110. IM client 140 may be any type of client program 

supporting instant messaging. Examples of such clients include AOL Instant Messenger 
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from America Online, Inc., ICQ instant messaging from ICQ Inc., MSN Messenger from 
Microsoft Corp., and Yahoo Messenger from Yahoo!, Inc. As those of skill in the art will 
appreciate, other IM clients programs may be used and are within the scope of the 
invention. 

5 In some embodiments, voice IM server 1 10 includes speech to text module 114, 

keypad input module 115, text to speech module 1 16, IM client module 118 and PIN 
management module 112. IM client module 1 18 is operable to communicate with an 
instant messaging client 140 over network 130. IM client module 1 18 in some 
embodiments of the invention supports communication with multiple IM clients 140, 

10 including the AOL Instant Messenger, ICS, MSN Messenger and Yahoo Messenger 
systems noted above. 

Network 130 may be any type of wired or wireless network supporting 
communications between computers. In some embodiments of the invention, network 
130 is the Internet. In alternative embodiments, network 130 comprises a private 

15 network such as a corporate intranet. The invention is not limited to any particular type 
of network. 

In some embodiments, keypad input module 1 12 is operable to receive keypad 
input from telephone 102. Typically the keypad input comprises DTMF (Dual Tone 
Multi-Frequency) tones that identify a key that a user presses on telephone 102. In some 

20 embodiments, the keypad input comprises a Personal Identification Number (PIN) that is 
input to voice IM server 110 and received by keypad input module 115. 

In some embodiments, a PIN database 120 contains data used to map a PIN to one 
or more user identifications valid on IM clients 140. As an example, an individual may 
use just one IM client, or a user may use multiple IM clients, each with their own user 

25 identification. In this case, a single PIN may be used for all the user identifications 

assigned to an individual. In some embodiments, the database may comprise a relational 
database management system such as Oracle, SQL Server, Sybase or Informix. In 
alternative embodiments, the database may comprise a file or files in a file system. The 
invention is not limited to any particular type of database to store PIN data. 

30 PIN management module 112 comprises software used to create, read, update and 

delete records in PIN database 120. For example, PIN management module 112 may 



Attorney Docket P1920US00 



create and assign a PIN to a user when the user registers an IM user identification with 
the system. The IM user can then provide this PIN to any person the IM user desires in 
order to enable that person to contact the IM user with a telephone. Additionally, PIN 
management module 112 may read data from PIN database 120 in order to map the PIN 
5 to a user identification. The user identification may then be used to establish an IM 
session with an IM client 140. 

Input for the session may be processed by keypad input module 1 15, or by speech 
to text module 114. If the input is keypad input, the keypad input module 115 translates 
the keypad input to text that is transmitted to an IM client 140, or to IM commands. If 

10 the input comprises voice signals, speech to text module 114 translates the speech to text 
that is transmitted to an IM client 140. 

Text to speech module 116 receives text from an IM client 140 through IM client 
module 118, and translates the text to speech that is then transmitted to telephone 102. 
Additionally, text to speech module 116 translates command and status information 

15 received from IM client module 118 into speech that can be transmitted to telephone 102. 

In some embodiments of the invention, a system incorporating IM client 140 may 
include a proximity detector 150. Proximity detector 150 may be any type of proximity 
detection mechanism. Examples of such proximity detection mechanisms include RFID 
(Radio Frequency Identifier) systems, ultrasonic proximity detection systems, and 

20 infrared proximity detection systems. Further, the proximity detection mechanism 
provided by the Bluetooth wireless communication protocol may be used in various 
embodiments of the invention. In some embodiments, the system may require the user to 
wear or carry a cooperating device. For example, in RFID based systems, the user may 
carry or wear an RFID tag. Similarly, in Bluetooth based systems, the user may wear or 

25 carry a Bluetooth enabled device. 

In these embodiments, proximity detector 150 may determine a change in the 
presence of an IM client user and communicate that change to the IM client 140. For 
example, an IM client user 152 that is using an IM client 140 may leave the vicinity of 
the system. Proximity detector 150 senses that the IM client user 152 has left, and can set 

30 the status information for the IM client so that parties communicating with client user 152 
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may be informed that the user is no longer present. Examples of such status types are 
provided below. 

In some embodiments, upon leaving the vicinity of the IM client 140 system, a 
timer starts. Status information indicating the user is no longer present is not set until the 
5 expiration of a timeout value. In these embodiments, the timeout value may be set so that 
the status information does not change when the user is not present for a relatively short 
period of time. 

Additionally, when a client user 152 enters the vicinity of a system running IM 
client 140, the proximity detector detects the presence of the client user 152 using any of 
10 the mechanisms described above, and sets the status information for the IM client 140 to 
indicate that the client user 152 is present. 

In alternative embodiments of the invention, if the IM client user that the user 
wishes to communicate with is not currently on-line, the IM client user may be notified 
using an off-line notification mechanism that a party desires to communicate with the IM 
15 client user. Additional details on these alternative embodiments of the invention may be 
found in United States Patent Application serial number 09/179,807 entitled "OFF-LINE 
PERSON NOTTFIER" which has been previously incorporated by reference. 

Further details on the operation of the above-described system will be provided 
below in the methods section. 



20 



Methods 



FIG. 2A is a flowchart illustrating a method according to an embodiment of the 
invention for communicating with an IM client using a telephone. The method to be 
performed by the constitute computer programs made up of computer-executable 

25 instructions. The computer-executable instructions may be read from a variety of 
computer-readable media, including but not limited to hard drives, floppy drives CD- 
ROMs, DVD-ROMs and signals transmitted over a wired or wireless network media. 
Describing the method by reference to a flowchart enables one skilled in the art to 
develop such programs including such instructions to carry out the methods on suitable 

30 computers (the processor or processors of the computer executing the instructions from 
computer-readable media). The method illustrated in FIG. 2 A is inclusive of acts that 
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may be taken by an operating environment executing an exemplary embodiment of the 
invention. 

The method begins when a user initiate a phone call to a system executing the 
method, such as voice IM server 110 (block 202). In some embodiments of the 
5 invention, the phone call will be to a toll free number assigned to the system, such as an 
"800" number. After initiating the phone call, the system receives a PIN (block 204). In 
some embodiments of the invention, the PIN is entered on the keypad of the user's 
phone. In alternative embodiments of the invention, a user may speak the PIN and the 
system converts the speech to text. 

10 Next, the system maps the PIN to one or more IM user identifications (block 206). 

Typically the mapping will be performed by consulting a database containing PIN 
mappings. In some embodiments of the invention, the user may enter an alphanumeric 
IM user identification directly using the keypad, rather than a PIN. In such embodiments 
it is not necessary to perform PIN mapping. 

15 In some embodiments, the system executing the method provides the user with a 

current status for one or more of the IM user identifications associated with the PIN 
(block 208). The type of status information will vary depending on the IM client, and 
may include the following status information: 

20 Off-line - the IM user is not currently on-line. 

On-line - the IM user is currently on-line. 

Away - the IM user is currently on-line, but away from their computer. 

Blocked - the IM user is currently blocking new connections. 

Be Right Back - the IM user is currently on-line, however is currently not 

25 monitoring their session, but will be right back. 

Next, in some embodiments, the system receives a selection of one of the 
available IM user identifications and initiates an IM session with the selected IM user 
identification (block 210). In alternative embodiments, if no status information is 
30 available, or if only one IM user identification is mapped to the PIN, the system 
automatically initiates an IM session. 

Blocks 210, 212 and 214 indicate activities that may occur in any order, and may 
occur in parallel with one another, and are thus shown at the same level in the flowchart. 



Attorney Docket P1920US00 



Further, the activities in blocks 210, 212 and 214 may occur in any combination of one or 
more of the activities. 

In some embodiments, the system receives keypad input that may be converted to 
IM commands or text that is sent to an IM client (block 210). In particular, keys on the 
5 keypad can be assigned as "shortcuts" for commands or text. For example, a key may be 
assigned as a shortcut for terminating the IM session. Further, a key may be assigned as 
a short cut for a text string such as "please call me". In addition, keypad input may be 
converted to alphanumeric text that is then transmitted to an IM client. 

In further embodiments, the system receives voice signals as input that may be 

10 converted to text (block 212). The text may then be sent to an IM client. In some 
embodiments, voice input may be interpreted as one or more commands for the IM 
session. In such embodiments, the user may introduce a command by speaking a 
recognized word or phrase that introduces the command. Speech other than IM 
commands may be converted to text for forwarding to the IM client. 

15 The system also receives text input from an IM client that is converted to speech 

for output to a telephone (block 214), thereby allowing the user at a telephone to receive 
the information conveyed via the IM session. In addition, as noted above, status 
information regarding the IM session may be converted to speech and output to the 
telephone. 

20 FIG. 2B is a flowchart illustrating a method according to an embodiment of the 

invention for maintaining status information for an IM client. The method illustrated in 
FIG. 2B is inclusive of acts that may be taken by an operating environment executing an 
exemplary embodiment of the invention. 

The method begins when a system running an EM client detects a change in the 

25 proximity of a user (block 220). As detailed above, the change in proximity may be 

determined using passive or active proximity detection systems, such as RFID, ultrasonic, 
infrared, or Bluetooth proximity detection systems. The embodiments of the invention 
are not limited to a particular proximity detection mechanism. 

Upon detecting a change in proximity, the system may change the status of the IM 

30 client depending on the change (block 222). Thus in some embodiments, if the proximity 
detection system determines that the IM client user is no longer present, the status of the 
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IM client may be changed to a status indicating the IM client user is not present. 
Similarly, if the proximity detection system determines that the IM client user has 
returned to the system and is now present, the status of the IM client may be changed 
accordingly. An exemplary set of status values has been provide above. 
5 Additionally, in some embodiments, a timeout mechanism may be used to 

determine a change in proximity. For example, if input activity such as keyboard or 
mouse activity is not present for a predetermined length of time, then the system may set 
an IM client status to indicated that the IM client user is not present. Conversely, the 
reoccurrence of input device activity such as keyboard or mouse activity may be used to 

10 set an IM client status to indicate that the IM client user is present. 

Figure 3 is a block diagram of a computer system 300 that shows components 
found in a common computer system such as a server computer capable of supporting 
various embodiments of the invention. Computer system 300 comprises a processor 302, 
a system controller 312, a cache 314, and a data-path chip 318, each coupled to a host bus 

15 310. Processor 302 is a microprocessor such as a 486-type chip, a Pentium®, Pentium® 
II, Pentium® III, Pentium® 4, or other suitable microprocessor. Cache 314 provides 
high-speed local-memory data (in one embodiment, for example, 512 kB of data) for 
processor 302, and is controlled by system controller 312, which loads cache 314 with 
data that is expected to be used soon after the data is placed in cache 3 14 (i.e., in the near 

20 future). Main memory 3 16 is coupled between system controller 312 and data-path chip 
318, and in one embodiment, provides random- access memory of between 16 MB and 
256 MB or more of data. In one embodiment, main memory 316 is provided on SIMMs 
(Single In-line Memory Modules), while in another embodiment, main memory 316 is 
provided on DIMMs (Dual In-line Memory Modules), each of which plugs into suitable 

25 sockets provided on a motherboard holding many of the other components shown in 
Figure 3. Main memory 316 includes standard DRAM (Dynamic Random- Access 
Memory), EDO (Extended Data Out) DRAM, SDRAM (Synchronous DRAM), or other 
suitable memory technology. System controller 312 controls PCI (Peripheral Component 
Interconnect) bus 320, a local bus for system 300 that provides a high-speed data path 

30 between processor 302 and various peripheral devices, such as graphics devices, storage 
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drives, network interfaces, etc. Data-path chip 318 is also controlled by system controller 
312 to assist in routing data between main memory 316, host bus 310, and PCI bus 320. 

In one embodiment, PCI bus 320 provides a 32-bit-wide data path that runs at 33 
MHz. In another embodiment, PCI bus 320 provides a 64-bit-wide data path that runs at 
5 33 MHz. In yet other embodiments, PCI bus 320 provides 32-bit-wide or 64-bit-wide 
data paths that run at higher speeds. In one embodiment, PCI bus 320 provides 
connectivity to I/O bridge 322, graphics controller 327, and one or more PCI connectors 
321 (i.e., sockets into which a card edge may be inserted), each of which accepts a 
standard PCI card. In one embodiment, I/O bridge 322 and graphics controller 327 are 

10 each integrated on the motherboard along with system controller 3 12, in order to avoid a 
board-connector-board signal-crossing interface and thus provide better speed and 
reliability. In the embodiment shown, graphics controller 327 is coupled to a video 
memory 328 (that includes memory such as DRAM, EDO DRAM, SDRAM, or VRAM 
(Video Random-Access Memory)), and drives VGA (Video Graphics Adaptor) port 329. 

15 VGA port 329 can connect to industry-standard monitors such as VGA-type, SVGA 
(Super VGA)-type, XGA-type (extended Graphics Adaptor) or SXGA-type (Super 
XGA) display devices. 

Other input/output (I/O) cards having a PCI interface can be plugged into PCI 
connectors 321. Network connections providing video input are also represented by PCI 

20 connectors 321, and include Ethernet devices and cable modems for coupling to a high 
speed Ethernet network or cable network which is further coupled to the Internet. The 
network connections may be wired or wireless. 

In one embodiment, I/O bridge 322 is a chip that provides connection and control 
to one or more independent IDE or SCSI connectors 324-325, to a USB (Universal Serial 

25 Bus) port 326, and to ISA (Industry Standard Architecture) bus 330. In this embodiment, 
IDE connector 324 provides connectivity for up to two standard IDE-type devices such as 
hard disk drives, CDROM (Compact Disk-Read-Only Memory) drives, DVD (Digital 
Video Disk) drives, videocassette recorders, or TBU (Tape-Backup Unit) devices. In one 
similar embodiment, two IDE connectors 324 are provided, and each provide the EEDE 

30 (Enhanced EDE) architecture. In the embodiment shown, SCSI (Small Computer System 
Interface) connector 325 provides connectivity for up to seven or fifteen SCSI-type 
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devices (depending on the version of SCSI supported by the embodiment). In one 
embodiment, I/O bridge 322 provides ISA bus 330 having one or more ISA connectors 
331 (in one embodiment, three connectors are provided). In one embodiment, ISA bus 
330 is coupled to I/O controller 352, which in turn provides connections to two serial 
5 ports 354 and 355, parallel port 356, and FDD (Floppy-Disk Drive) connector 357. At 
least one serial port is coupled to a modem for connection to a telephone system 
providing Internet access through an Internet service provider. In one embodiment, ISA 
bus 330 is connected to buffer 332, which is connected to X bus 340, which provides 
connections to real-time clock 342, keyboard/mouse controller 344 and keyboard BIOS 
10 ROM (Basic Input/Output System Read-Only Memory) 345, and to system BIOS ROM 
346. 

Conclusion 

Systems and methods for providing access to IM clients using a telephone have 
15 been described above. Although specific embodiments have been illustrated and 
described herein, it will be appreciated by those of ordinary skill in the art that any 
arrangement that is calculated to achieve the same purpose may be substituted for the 
specific embodiments shown. This application is intended to cover any adaptations or 
variations of the present invention. 
20 The terminology used in this application is meant to include all of these 

environments. It is to be understood that the above description is intended to be 
illustrative, and not restrictive. Many other embodiments will be apparent to those of 
skill in the art upon reviewing the above description. Therefore, it is manifestly intended 
that this invention be limited only by the following claims and equivalents thereof. 

25 
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